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Abstract.  We  discuss  and  solve  the  problem  of  constructing  a 
diffeomorphic  componentwise  extension  for  an  arbitrary  invertible  com- 
binatorial function.  Interpreted  in  physical  terms,  our  solution  constitutes 
a proof  of  the  physical  realizability  of  general  computing  mechanisms  based 
on  reversible  primitives. 

Keywords.  Invertible  combinatorial  functions,  continuous  extensions,  revers- 
ibility, Boolean  functions. 


1.  Motivations 

In  an  ordinary  digital  computer,  the  two  logic  states  associated  with  a bi- 
nary signal  arc  realized  as  distinguished  values  of  a continuous  variable  which 
represents  the  range  of  a physical  quantity;  correspondingly,  the  logic  function 
associated  with  a given  combinatorial  network  is  realized  as  the  appropriate 
restriction  of  a suitaolc  continuous  function  which  characterizes  a physical  sys- 
tem involving  a number  of  such  quantities.  If  the  logic  function  is  not  invertible 
(note  that  a computation  may  yield  the  same  output  for  different  inputs),  its 
continuous  extension  cannot  be  invertible.  On  the  other  hand,  the  microscopic 
physical  laws  which  underly  the  operation  of  a computer  are  presumed  to  be 
strictly  reversible,  i.e.,  they  uniquely  specify  a trajectory  both  forward  and 
backward  in  time.  Thus,  it  is  clear  that  a noninvertible  continuous  function 
such  ns  the  above  characterizes  a physical  system  only  in  terms  of  statistics/ 
mechanics,  rather  than  of  microscopic  mechanics.  In  other  words,  such  a function 
is  necessarily  an  incomplete  specification  of  a mechanical  systemjl];  in  particular, 
it  does  not  give  one  the  means  to  deal  in  any  detail  with  the  information  that 
is  “discarded"  during  a computation,  besides  accounting  for  it  in  terms  of  the 
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increase  of  a single  scalar  quantity,  the  entropy  of  the  system(2]. 

In  an  attempt  to  exercise  some  control  on  the  details  of  the  worlr-to-heat 
conversion  processes  that  accompany  physical  computing  (and  which  are  related 
to  the  irreversibility  of  computation),  one  may  conceive  of  a different  approach 
to  the  mathematical  modeling  and  the  design  of  computcrs[3]  (see  Appendix  for 
a brief  summary).  In  that  approach,  a major  obstacle  to  arriving  at  a complete 
specification  of  a mechanical  system  is  removed,  since  computation  is  modeled 
exclusively  in  terms  of  invertible  combinatorial  functions.  It  remains  to  show 
that  such  functions  admit  in  general  of  a physical  realization.  This  we  do  in  the 
present  paper. 


2.  Statement  of  the  problem 

GOAL  2.1  Given  the  set  B = {0,1}  and  an  invertible  function 
: Bn  — » B”,  find  a connected  manifold  M D B and  a diffcomorphism 
F W : Mn  — ► Mn  such  that  is  a restriction  of  f^nK 

Our  goal  can  be  given  the  following  kinematical  interpretation.  Consider  a 
box  having  n input  levers  and  n output  levers,  as  depicted  in  Figure  2.1  for  n — 2. 


Fig.  2.1  Realization  of  a combinatorial  function  by  meant  of  con- 
tinuous mechanisms. 

M represents  the  range  of  accessible  positions  for  each  lever  (a  manifold  is  the 
appropriate  mathematical  structure  for  describing  this  range).  Two  distinguished 
positions  within  M arc  marked  "0"  and  “1”.  Assume  that  the  input  levers  are 
interconnected  to  the  output  ones  by  means  of  a passive  physical  mechanisms 
(for  instance,  an  assembly  of  gears,  cams,  etc.)  in  such  a way  that 
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(a)  When  all  input  levers  occupy  distinguished  positions,  so  do  all  the  out- 
put ones.  In  this  way,  the  box  “computes”  a combinatorial  function  from 
binary  ra-tuplcs  to  binary  n-tuples. 


(b)  The  collective  configuration  of  the  output  levers  is  a continuous  func- 
tion of  the  input  configuration.  Continuity  should  extend  to  the  higher 
derivatives  (velocity,  acceleration,  etc.). 


(c)  The  box  is  reversible,  i.e.,  condition  (b)  holds  when  input  and  output 
levers  are  exchanged. 


Clearly,  (c)  implies  that  (a)  too  holds  when  input  and  output  levers  are  ex- 
changed. Thus,  the  combinatorial  function  “computed"  by  the  box  must  be  in- 
vertible. We  want  design  principles  to  construct  a box  with  the  above  properties 
for  an y invertible  combinatorial  function  f-n\  The  specifications  for  such  a box 
will  be  represented  by  a d iff  comorphism  from  M"  to  Mn.  (When  one  is 
dealing  with  manifolds  instead  of  intervals  of  the  real  line,  a d isomorphism  is 
the  appropriate  generalization  of  a bicontinuous  function). 


It  must  be  stressed  that  Goal  2.1  does  not  just  ask  for  an  arbitrary 
difTeomorphic  extension  of  the  given  function  J W to  an  arbitrary  manifold. 
Rather,  the  extension  must  be  componentwise.  In  other  words,  besides  being 
a superset  of  B",  the  manifold  must  also  be  of  the  form  Mn,  i.e.,  possess  the 
same  Cartesian  product  structure  as  Bn;  moreover,  the  extension  itself  must 
maintain  the  variables  separated,  i.e.,  each  component  of  the  extension  must  be 
an  extension  of  the  corresponding  component  of  the  given  function.  In  physi- 
cal terms,  each  binary  variable  must  be  encoded  in  a separate  “channel,”  so 
that  in  interconnecting  several  boxes  of  this  kind  each  variable  may  be  routed 
independently  of  the  others.  Figure  2.2  illustrates  the  case  of  an  extension  that 
is  not  componentwise.  This  box  too  “computes”  a combinatorial  function,  but 
it  is  hard  to  sec  how  the  components  of  the  input  n-tuple  could  be  made  to 
come  from  different  boxes,  and  those  of  the  output  n-tuple  go  to  different  boxes, 
without  using  complex  encoders  and  decoders  for  which  the  problem  of  physical 
realizability  would  arise  afresh. 


Fig.  2.2  An  extension  which  is  not  componentwise.  Only  one  degree 
of  freedom  is  used  to  represent  several  binary  variables. 


3.  Notation  and  mathematical  preliminaries 

We  shall  be  dealing  exclusively  with  functions  that  are  invertible,  and 
whose  domain  and  range  are  structured  sets,  i.e.,  are  explicitly  given  as  indexed 
Cartesian  products  of  sets.  In  particular,  in  all  cases  domain  and  range  will  be 
products  of  identical  sets  and  will  coincide. 

A restriction  of  a function  of  the  form  $ : A — » B is  usually  defined  by 
specifying  a subset  A of  the  domain  A.  However,  when  invertibility  is  an  issue, 
it  is  necessary  to  explicitly  specify  also  the  restriction's  intended  range.  Thus, 
by  the  restriction  of  $ to  ( A,B ) (where  A C A and  B C B)  we  shall  mean  the 
relation  <\>  from  A to  B such  that  afb  whenever  a £ A,  b £ B,  and  0(a)  6. 

Whether  <f>  is  indeed  a function,  and  an  invertible  one  for  that  matter,  depends 
on  the  choice  of  A_and  B.  If  <f>  is  the  restriction  of  0 to  (A,B),  then  0 is  an 
extension  of  <{>  to  ( A,B ). 

Given  ^ : A\  X • • • X Am  -♦  Bi  X • • • X Bn,  an  extension  0 of  ^ to  ( P , Q) 
is  cotnponentwise  if_there  exist_sets  A,  D Aj  and  B,  3 B,  such  that  P ■■  A\  X 
• • • X Am  and  Q — * B\  X • • • X Bn.  In  this  case,  ^ is  a componentwise  restriction 
of  0. 

When  the  domain  of  a function  is  an  indexed  Cartesian  product  of  sets,  it  is 
convenient  to  speak  of  input  variables  (or  input  components,  or,  simply,  argu- 
ments) of  the  function,  using  the  same  indexing  as  for  the  corresponding  sets.  If 
also  the  rangcof  the  function  is  an  indexed  Cartesian  product,  one  may  likewise 
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speak  of  output  variables  (or  output  components)  of  the  function.  In  ordinary 
function  composition,  an  output  variable  of  one  function  may  be  substituted  for 
any  number  of  input  variables  of  other  functions,  i.e.,  “fan-out"  is  allowed,  as 
indicated  in  Figure  3.1a.  In  what  follows,  we  shall  use  a more  restricted  form  of 
composition,  called  one-to-one  composition,  where  any  substitution  of  output 
variables  for  input  variables  must  be  one-to-one,  as  indicated  in  Figure  3.1b.  If 
the  output  variable  and  the  input  variable  involved  in  every  such  substitution 
range  over  identical  sets,  then  one-to-one  composition  always  yields  invertible 
functions  when  applied  to  invertible  functions. 


Fig.  3.1  (a)  Examples  of  ordinary  composition  and  (b)  one-to-one 

composition  of  functions. 

A re-indexing  of  input  or  output  variables  is  a special  case  of  one-to-one  composi- 
tion. One-to-one  composition  is  conveniently  handled  by  means  of  an  algebraic 
notation  formally  analogous  to  that  of  tensor  calculus[4].  From  a physical  view- 
point, the  one-to-one  constraint  reflects  the  fact  that  signal  fan-out  requires  a 
source  of  energy  other  than  that  carried  by  the  signal  itself. 

Let  <j>  be  a binary  relation  from  S X X • • • X C/„  to  & X C/j*  • • X C/^,, 
where  the  sets  U\, . . .,  Un,  U\, . . .,  U'n,  are  singletons.  For  convenience,  the  one 
element  of  any  of  these  singletons  will  be  denoted  by  o.  The  variables  associated 
with  these  singletons  will  be  called  dummy.  A relation  $ from  S X 14,  X • • • X t/y 
to  S*  X V'n  X • • • X U'jpl,  where  l<»i  < • • • < ip<n  and  1 < >i<-  • • < >/<n, 
is  said  to  be  obtained  from  <f>  by  deletion  of  dummy  variables  if 

n n'  P ft 

(s,  o^y^o)<i>{^ , o^y^o)  m (s,o^Tt 

that  is,  if  the  two  relations  coincide  when  the  trailing  o's  which  accompany  each 
tuple  are  disregarded. 
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Finally,  a combinatorial  function  is  one  of  the  form  /:  Bm— ► Bn,  where  B 
is  the  binary  set  {0, 1}. 


4.  Main  results 

DEFINITION  4.1  Consider  the  set  B = {0,1}  with  the  usual  structure 
of  Boolean  ring,  with  “©"  (excIusive-OR)  denoting  the  addition  operator,  "0” 
the  additive-inverse  operator  (which  in  this  case  coincides  with  the  identity 
operator),  and  “o"  (and)  the  multiplication  operator.  For  any  n > 0,  the 
and/nand  function  of  order  n,  denoted  by  0^:  Bn— ► B",  is  defined  by 


[*l  \ 

f Xl 

X2 

x2 

• 

• 'j 

• 

• ( 

xn — 1 

xn — 1 

\xn  J 

© Xl  O X2  O • • • O Xn_i  / 

(4.1) 


REMARK  4.1  (a)  The  0 sign  in  (4.1),  which  is  redundant  (since  ©x„  = 
x„),  has  been  introduced  for  symmetry  with  (4.2)  below,  where  it  is  not  redun- 
dant. (b)  For  any  n > 0,  0 M is  invertible  and  coincides  with  its  inverse,  (c) 
For  i = 1, 2, . . .,  n — 1,  the  i-th  component  of  (fin\  i.e.,  0$n\  coincides  with  the 
selector  operator  for  the  corresponding  argument,  i.e.,  0$n^(xi, . . .,x„)  = x*.  (d) 
The  last  component  of  0^,  i.e.,  0^\  coincides  with  the  Boolean-complement 
operator  for  n = 1 (note  that  xi  o • • • o x*  = 1 when  t « 0),  and  with  the 
exclusivc-oR  of  its  two  arguments  for  n = 2.  (e)  For  all  other  values  of  n,  Offi 
is  still  linear  in  the  n-th  argument,  but  is  nonlinear  in  the  first  n — 1 arguments. 

The  family  of  and/nand  functions  was  introduced  by  Toffoli[5]  for  proving 
the  computation  and  construction  universality  of  reversible  cellular  automata. 
An  earlier,  brief  mention  of  the  and/nand  function  of  order  3 can  be  found  in  [2]. 


LEMMA  4.1.  Any  invertible  combinatorial  function  of  order  n can  be  ob- 
tained by  one-to-one  composition  of  and/nand  functions  of  order  <n. 

Proof.  In  the  following  construction  we  shall  make  use  only  of  6^  (where  n 
is  the  order  of  the  given  function)  and  of  0^  (the  Boolean-complement  operator). 

By  definition,  0(n)  is  a permutation  on  the  set  of  n-tuples  over  B.  (a)  Any 
permutation  can  be  written  as  the  product  of  elementary  permutations,  i.e., 
of  permutations  that  exchange  only  two  r»-tuples.  In  turn,  as  we  shall  prove 
below,  (b)  any  elementary  permutation  on  Bn  can  be  written  as  the  product  of 
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atomic  permutations,  i.e.,  of  permutations  that  exchange  two  n-tuples  which 
differ  in  only  one  component.  Observe  that  0 W is  the  atomic  permutation  which 
exchanges  (1, 1, . . 1, 0)  with  (1, 1, . . 1, 1).  By  reordering  the  components  of 
0 and  applying  0^  to  selected  components  one  obtains  the  family  of  all  atomic 
permutations.  Note  that  all  the  operations  used  above  are  forms  of  one-to-one 
composition.  It  remains  to  prove  (b);  this  is  done  in  the  following  way. 

The  n-tuplcs  a\,  a,  are  said  to  form  a Gray-code  path  if  two  adjacent 

»>tuples  differ  by  an  atomic  permutation.  It  is  easy  to  verify  that  by  means  of 
sequence  of  atomic  permutations  the  element  at  the  beginning  of  the  path  can 
be  moved  to  the  end  position,  leaving  the  remainder  of  the  path  unchanged.  By 
repeating  such  a move  the  first  and  last  elements  can  be  exchanged.  The  proof 
is  completed  by  observing  that  any  two  n-tuples  can  be  joined  by  a Gray-code 
path.Q 


l 


t 


* 


t 
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LEMMA  4.2  Consider  the  1-manifold  ft  obtained  by  identifying  all  points 
of  the  real  line  R that  differ  by  a multiple  of  2x  (ft  can  be  thought  of  as  the 
real  circle),  and  let  the  points  0 and  1 of  B coincide  with,  respectively,  0 and  w 
of  ft.  Then  there  exists  a difTcomorphism  from  ftn  to  ftn  whose  restriction  to 
(B",  B")  coincides  with  0^n\ 

Proof.  Consider  ft  with  addition  (“®")  and  additive  inverse  (“©”)  induced 
from  those  on  R,  and  multiplication  (V')  defined  as  follows 


xoy 


1 — cosx  1 — cosy 

* 2 2 


ft  satisfies  all  the  axioms  for  a ring  except  distributivity.  Let  ©(");  ft"— ► 
defined  by 


fx\  \ 

f X 1 \ 

*2 

X2 

©<">: 

• 

• 

• 

*n-l 

t— ► 

• 

• 

xn~  1 

Un  ^ 

® X\  O X2  O • • • O Xn-J 

ft"  be 


(4.2) 


Observe  that  when  the  operators  defined  on  ft  are  restricted  to  B C ft  the 
Boolean-ring  structure  for  B is  recovered;  thus,  the  restriction  of  ©W  to  (Bn,  B") 
coincides  with  0^n\  Moreover,  ©M  is  infinitely  differentiable  by  construction 
and  coincides  with  its  inverse;  thus,  ©(")  is  a diffeomorphism.l 

As  an  immediate  consequence  of  Lemmas  4.1  and  4.2,  one  obtains  the 
following  theorem  (cf.  GOAL  2.1). 
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THEOREM  4.1  Given  any  invertible  combinatorial  function 
j(n) . Qn  gn  uiere  exjst  a connectC(f  manifold  MDB  and  a diffeomorpbism 
F^ : Mn  — ► Mn  such  that  is  the  restriction  of  to  (Bn,  Bn). 


5.  Additional  results 


Before  continuing  with  our  mathematical  exposition,  it  will  be  useful  to 
verify  in  an  intuitive  way  the  physical  realizability  of  the  functions  0^.  With 
reference  to  Figure  2.1,  we  shall  consider  boxes  whose  input  and  output  levers 
are  constrained  to  circular  motion  (i.e.,  are  cranks).  In  close  correspondence  with 
the  defining  formula  (4.2),  0^  will  be  realized  as  in  Figure  5.1a,  and  0^  as 
in  Figure  5.1b,  where  ® represent  the  mechanisms  known  as  the  "differential" 
which  is  used,  for  example,  in  automobile  transmissions.  In  this  mechanism,  the 
angles  p,  </,  and  r satisfy  the  relation  q — p -f-  r. 


Fig.  5.1  ( a ) Realization  of  (b)  Realization  of  0^. 


0^3^  will  be  realized  as  in  Figure  5.2a,  where  the  mechanism  denoted  by  and  is 
illustrated  in  more  detail  in  Figure  5.2 b.  Basically,  the  rotary  motion  of  the  two 
input  shafts  is  converted  to  linear  motion  along  two  orthogonal  axes  x and  y.  The 
resulting  composite  motion  operates  a cam  in  whose  two-dimensional  surface 
the  product  of  the  two  orthogonal  displacements  is  encoded  as  a displacement 
along  the  z axis.  A "finger"  follows  the  surface  of  the  cam  and  contributes  an 
additive  term  to  the  differential. 
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Fig.  5.2  (a)  Realization  of  0^3K  (b)  Details  of  the  and  mechanism. 

In  general,  0^  will  be  realized  according  to  the  scheme  of  Figure  5.3,  which 
is  convenient  also  for  representing  the  corresponding  discrete  function  0^nK  The 
(n — l)-dimcnsional  cam  required  for  the  (n — l)-input  and  mechanism  can  be 
realized  by  cascading  a suitable  number  of  two-dimensional  cams.  Note  that, 
although  our  construction  makes  use  of  rotary-to-Iinear  conversion,  which  by 
itself  is  not  an  invertible  operation  and  in  general  may  introduce  “dead  points” 
in  a mechanism,  the  resulting  overall  mechanism  is  indeed  reversible. 


x» 


Fig.  5.3  Schematic  representation  of  0^  or  0^ 

Returning  to  our  mathematical  exposition,  let  us  observe  that  Lemma 
4.1  supplies  a set  of  invertible  primitives  for  constructing — via  one-to-one 
composition — any  invertible  combinatorial  function.  However,  this  set  is  un- 
bounded, in  the  sense  that  0's  of  ever  larger  order  may  be  needed  as  the  order  of 
the  given  invertible  function  increases.  It  is  well  known  that  any  combinatorial 
function  can  be  synthesized  by  ordinary  function  composition  starting  from  a 
single  computing  primitive  such  as  the  two-input  nand  function.  In  analogy 
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with  this,  can  Lemma  4.1  be  strengthened  so  as  to  require  only  a finite  set  of 
primitives?  According  to  Theorem  5.1  below,  the  answer  to  this  question  is  nega- 
tive. However,  Theorem  5.2  shows  that  0^  is  a universal  primitive  for  invertible  t 

combinatorial  functions  if  componentwise  restriction  and  deletion  of  dummy 
variables  arc  allowed  in  addition  to  one-to-one  composition.  Using  the  same 
operations  (which  have  a simple  interpretation  in  terms  of  physical  realizability), 
it  is  possible  to  construct  a difieomorphic  componentwise  extension  of  any  in- 
vertible combinatorial  function  using  as  a primitive  (Theorem  5.3).  In  view 
of  the  many  constraints  imposed  on  the  construction,  this  result  is  quite  strong. 

We  conjecture  that  it  is  the  strongest  possible. 

THEOREM  5.1  There  exist  invertible  combinatorial  functions  of  order  n 
which  cannot  be  obtained  by  one-to-one  composition  from  and/nand  functions 
of  order  < n. 

Proof.  In  the  same  context  as  the  proof  of  Lemma  4.1,  0^  permutes  exactly 
2n  1 n-tuplcs  of  Bn.  Thus,  only  even  permutations  can  be  obtained  when  i > 0. 

Since  the  product  of  even  permutations  is  even,  only  even  permutations  can  be 
obtained  by  one-to-one  composition  of  any  number  of  and/nand  functions  of 
order  < n.[] 

THEOREM  5.2  Any  invertible  combinatorial  function  can  be  obtained 
by  one-to-one  composition,  componentwise  restriction,  and  deletion  of  dummy 
variables  from  0^3K 

Proof.  Consider  the  function  ^ of  Figure  54.  A value  of  0 for  the  fifth 
input  component  always  results  in  a value  of  0 for  the  corresponding  output 
component. 


Fig.  54  Construction  of  tfsK  When  x$  ■■  0,  also  — 0.  The 
remaining  components  behave  as  the  corresponding  ones  offW. 
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From  the  restriction  of  to  (B3  X {0},  B3  X {0})  one  obtains  0^  by  deletion  of 

the  dummy  variables  X5  and  ys.  In  a similar  way,  all0^  (n  > 3)  can  be  obtained. 
OW  and  are  obtained  directly  from  0^  when  the  first  and,  respectively,  the 
first  two  components  are  restricted  to  the  value  1 and  the  resulting  dummy 
variables  arc  deleted.  If  one-to-one  composition  i6  applied  before  deletion,  it  is 
easy  to  verify  that  the  number  of  deletions  (i.e.,  the  number  of  constant  inputs) 
required  for  the  construction  of  any  invertible  combinatorial  function  of  order 
n does  not  exceed  2 n — 3.Q 

THEOREM  5.3  For  any  invertible  combinatorial  function  a 

difTcomorphic  componentwise  extension  can  be  obtained  by  one-to-one  com- 
position, componentwise  restriction,  and  deletion  of  dummy  variables  from  S^. 

Proof.  The  proof  parallels  that  of  Theorem  5.2.Q 

6.  Conclusions 

Computing  is  based  on  the  evaluation  of  functions  that  are  discrete  and 
many-io-one.  On  the  other  hand,  the  mechanisms  offered  by  a schematization 
of  physics  such  as  classical  mechanics  are  based  on  functions  that  are  continuous 
and  one-to-one.  We  have  explicitly  bridged  the  gap  between  these  two  concep- 
tions. 

Appendix 

The  question  of  whether  there  exist  reversible  systems  (i.e.,  systems  charac- 
terized by  an  invertible  transition  function)  which  possess  universal  computing 
capabilities  has  been  considered  by  many  authors  (see  [5]  for  references).  The 
answer  to  this  question  is  positive.  For  our  purposes,  it  will  be  sufficient  to  recall 
the  following  basic  proposition[3]: 

For  every  combinatorial  function  <j>:  Bm  — » Bn  there  exists  an  invertible 
combinatorial  function  /fm+f);  Bm+f  — ♦ Bm+f  (with  r<n)  such  that 

/\  /^m"*”r^(®l»  • • •»  *m>  0»  • • •»  ®)  " ^»(* 1»  • • •>  *m)> 

l<i<n 

Informally,  the  required  function  <j>  is  obtained  from  /(m+r)  by  assigning  constant 
values  to  the  r additional  input  components  and  ignoring  the  "random'’  values 
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obtained  for  the  m + r — n additional  output  components.  (We  use  the  term 

"random”  for  output  values  that  depend  on  the  first  m input  arguments  and  thus 

cannot  be  used  as  constants  for  a new  computation.  By  contrast,  the  additional  i 

output  components  used  in  the  proof  of  Theorem  5.2  yield  "nonrandom”  values.) 

> We  cannot  avoid  mentioning  the  analogy  of  the  above  scheme  of  computa- 

tion with  the  functioning  of  ordinary  physical  computers,  where  one  must  supply 
work  (i.e.,  a nonrandom  form  of  energy)  in  addition  to  the  input  signals,  and 
remove  heat  (i.e.,  energy  in  random  form)  in  addition  to  the  output  signals. 
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